Towards a large deviation theory for statistical-mechanical complex systems 
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The theory of large deviations constitutes a mathematical cornerstone in the foundations of 
Boltzmann-Gibbs statistical mechanics, based on the additive entropy Sbg = —ksYl^iPi^'^P'- 
Its optimization under appropriate constraints yields the celebrated BG weig ht e"''^*. An ele- 
mentary large-deviation connection is provided by independent binary variables, which, in the 
A — > oo limit yields a Gaussian distribution. The probability of having n ^ N/2 out of N throws is 
governed by the exponential decay e~^^ , where the rate function r is directly related to the relative 
BG entropy. To deal with a wide class of complex systems, nonextensive statistical mechanics has 

been proposed, based on the nonadditive entropy Sq — ks — gSi ' (<? € TZ; Si — Sbg)- Its opti- 
mization yields the generalized weight Cq (e^ = [1 -I- (1 — 5)2]^'''^"'''; ef = e^). We numerically 
study large deviations for a strongly correlated model which depends on the indices Q £ [1,2) and 
7 G (0, 1). This model provides, in the N ^ 00 limit (V7), Q-Gaussian distributions, ubiquitously 
observed in nature (Q — >■ 1 recovers the independent binary model). We show that its correspond- 
ing large deviations are governed by (oc l/A^''''"^' if g > 1) where q = ^^IZq) + 1 > 1- 
This g-generalized illustration opens wide the door towards a desirable large-deviation foundation 
of nonextensive statistical mechanics. 

PACS numbers: 02.50.-r,05.20.-y,05.40.-a,65.40.gd 



In his 1902 historical book Elementary Principles in Statistical Mechanics [ij, Gibbs emphasizes that systems 
involving long-range interactions are intractable within the Boltzmann-Gibbs (BG) theory, due to the divergence of 
the partition function. Amazingly enough, this crucial remark is often overlooked in most textbooks. However, this is 
clearly why no standard temperature-dependent thermostatistical quantities (e.g., specific heat) are computable for 
the free hydrogen atom, for instance. Indeed, an infinite number of excited energy levels accumulate at the ionization 
value, which makes the canonical partition function to trivially diverge jit any finite temperature. 

To solve this and related complexities it has been proposed in 1988 2- 5] a generalization of the BG theory, currently 
referred to as nonextensive statistical mechanics. It is based on the nonadditive entropy 

Sq^kB (ge7^;^p.-l), (1) 

i=i 

which recovers Sbg — X^i^i Pi I'^P* f*^^ q ^ 1. li A and B are two probabilistically independent systems 
(i.e., pf^'^ = pfpf, V(i,j)), definition implies the nonadditive relation ^^^^^ = ^^^TT^ + ^^^T^ + (1 - 
q) "^j,^ — ^"TTS — ■ Moreover, if probabilities are all equal, we straightforwardly obtain Sq = ks^'O-qW , with 
\a.q z = ^ il^^ (lui 2 — In 2). If we extremize ([!]) with a constraint on its width (in addition to normalization of 
the probabilities {pi\), we obtain 

eq^" 

being the inverse function of the g-logarithmic function, i.e., = [1 + (1 — g)^]-'^/^^"'^ (ef = e^); {Ei} are the 
energy levels; Pq is an effective inverse temperature. 

Complexity frequently emerges in natural, artificial and social systems. It may be caused by various geometrical- 
dynamical ingredients, which include non-ergodicity, long-term memory, multifractality, and other spatial-temporal 
long-range correlations between the elements of the system. During the last two decades, many such phenomena have 
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FIG. 1: Tossing A*" independent coins: the large-deviation probability P{N; n/N < x) decays exponentially with A''. The slopes 
are given by the rate function ri[x), which is shown in Fig. |2] 



been successfully approached in the frame of nonextensive statistical mechanics. Predictions, verifications and various 
applications have been performed in high-energy physics f6l-[Tll . spin-glasses fl3 . cold atoms in optical lattices fl^, 
trapped ions anomalous diffusion jisl ). dusty plasmas |l6l|. solar physics [UHll , relativistic and nonrelativistic 
nonlinear quantum mechanics ,22.] . among many others. 

It is known since several decades that the mathematical foundation of BG statistical mechanics crucially lies on the 
theory of large deviations (see [2^[23] and references therein). To attain the same status for nonextensive statistical 
mechanics, it is necessary to g-generalize the large deviation theory itself. The purpose of the present effort precisely 
is to make a first step towards that goal through the study of a simple model. 

Let us start with the standard example which consists in tossing N times a (fair) coin. The probability of obtaining 
n (n = 0, 1, . . . iV) heads is given by 

N\l_ 

n 2^ 



PN.n =[ „ ]t^, (3) 



and the probability of having a ratio n/N smaller than x with < x < 1/2 (the case 1/2 < a; < 1 is totally symmetric) 
is given by 

P{N;n/N<x)= ^ pN,n (4) 

It is straightforward to obtain that, in the N —i' oo limit, 

P(7V; n/iV < a;) ~ e-^''i(^) (0<x<l/2), (5) 

where the subindex 1 in the rate function ri{x) will soon become clear. This exponential decay with TV, deeply related 
with the exponential decay with energy of the BG weight (namely, the q = I particular case of Eq. ([2])), can be 
verified in Fig. [T] 

The rate function ri (x) also is easy to analytically calculate for the present trivial model. The relative entropy 
or mutual information for a single random variable with discrete W events with probabilities {pi} {i = 1, . . . , W) is 
defined as 

W (0) 

/i = -5]pan^, (6) 

where p^^"* is a reference distribution. By choosing as the uniform distribution, (i.e., p'"' = we have 

w 

h =\nW -y"p^\n— ^\nW - (7) 
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FIG. 2: The rate function for independent binary variables. The dots have been numerically obtained from Fig. [T] The 
continuous curve corresponds to Eq. 



For a coin we have W = 2 {head or tail), hence Ii reads 

Ii = In 2 + pi Inpi + p2 lnp2 ■ 
By identifying {pi,p2) — >■ (cc, 1 — x) we obtain 

ri (x) = In 2 + .T In a; + (1 — a:) In (1 — a;) , 



(8) 



(9) 



as can be verified in Fig. (3] 

Before focusing on a model of correlated coi ns, let us g-generalize Eq. Definition ^ and the nonadditive 

entropy Sq naturally lead to the generalization [25| 



w 



(O)Nq-l 



1] 



i=l 



1 



By once again choosing as {p^^'} the equiprobability distribution (i.e., p^^' — l/W), we have 

S„ 



Kb 



For W — 2 and {pi,P2) -> — x), we obtain 



1-9 



[l-2''-i[x« + (l-a;)'?]] 



(10) 



(11) 



(12) 



which recovers expression ^ for q ~> 1. 

Let us now extend the above model to the case where the coins might be strongly correlated. The simple model that 
we have just reviewed yields, for -> cx), a Gaussian distribution. This conforms to the Central Limit Theorem, valid 
for sums of many independent random variables whose variance is finite. This classical theorem has been g-generalized 
[26| for a special class or correlations referred to as g- independence (1-independence recovers standard independence). 
The attractors in the probability space are g-Gaussians, which precisely extremize the (continuous form of the) entropy 
Sq when an appropriately generalized g-variance is maintained fixed. It is then this class of correlations that we are 
going to focus on here in order to illustrate how the classical large-deviation theory can be generalized. We adopt the 
specific class of binary variable models introduced in [23|- These models consist in discretized forms of Q-Gaussians 
(1 < Q < 2) [285, which exactly converge onto Q-Gaussians in the limit N ^ 00. The {pN,n} in Q are now given by 



PQ{yN,n) 
N 

^PQ{VN,n) 
n=0 



(13) 



4 



where 

Pq(z)cx[1 + (Q-1)z2]-i/(Q-i) (14) 

and yN,n (n = 0, 1, . . . , N) correspond to {N + 1) equally spaced points in the support of the discretized Q-Gaussian. 
More precisely, j/Ar^„ — An (-^ - 1/2) G [-AAr/2, AAr/2], where 

An = S{N + 1)'' (J>0;0<7<1). (15) 

The model is fully determined by {Q, 7,(5). Fig. [3] (left column) shows how the distributions P{y) — -^PN,n 
approach the corresponding Q-Gaussians while N increases. 

We observe that, for each pair of values (Q, 7), P{N\ n/N < x) presents a g-logarithmic decay (see Fig [31 right 
column), i.e., 

P(7V; n/iV < x) ~ e-^'^«(^) (0 < a; < 1/2) , (16) 

where 

+1 (0 < a; < 1/2; V(5), (17) 



7(3 - Q) 



hence, 

1 



7(9-1) 



1 (0 < X < 1/2; V5). (18) 



We see that, for Q = 1 hence q — 1, Eq. (IT6)) recovers Eq. ([5]). For Q > 1, we have g > 1, consequently 
P{N] n/N < x) (X 1/N^^^'^^^\ i.e., a power law instead of exponential. We also verify that, the value of q for a; = 0, 
noted qix=o], differs (possibly due to a boundary effect) from the value corresponding to < a; < 1/2, noted qio<x<i/2] 
and given by Eqs. ([T7]) or ([T^. For all (Q, 7, 6) we have that 

q[.=o] = 2 . (19) 

9[0<x<l/2] 

The rate function satisfies, for < a; < 1/2, 

rgix;Q;r,5)=rg{x;Q;ra)S'^'' ((5 > 0) , (20) 

where rq{x; Q; 7; 1) depends on the model parameters (Q,7), as illustrated in Fig. 2] [notice that Eq. (ITSI) yields 
Ajv ~ {NS^^'^)'^ for N » 1]. In all cases, due the above mentioned boundary effect, rg(0) < MiJix^o^qix)- For 
comparison purposes we have also represented, in this same figure, Iq{x) as given by Eq. (fT2)) . We verify that, 
although it is of the same order of magnitude as rq{x), it does not coincide with the numerical results from Fig. [3] 
(neither the corresponding /g(x)'s, not shown in the figure, coincide). This cannot be considered as surprising since 
the present model includes, for Q > 1, nontrivial correlations between the N random variables, which have not been 
taken into account in the calculation of (fT2|) . It is however remarkable that the exponent of the q-exponential (fT6|) 
remains extensive (i.e., proportional to N) for all values of Q. Since the nature of this exponent is entropic, this 
results naturally reinforces the approach currently adopted in nonextensive thermostatistics, where, in the presence 
of strong correlations, one expects a value of the index q to exist such that Sq preserves the extensivity it has in the 
BG theory |5|, M iH . 

The present study opens the door to a g-generalization of virtually many, if not all, of the classical results of 
the theory of large deviations. In this sense, the present effort points a path which would be parallel to the q- 
generalization of the classical and Levy-Gnedenko Central Limit Theorems [2^. Indeed, the present results do suggest 
the mathematical basis for the ubiquity of q-exponential energy distributions in nature, just as the g-generalized 
Central Limit Theorem suggests the ubiquity of g-Gaussians in nature. 
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FIG. 3: Illustrative histograms of the discretized model (left column) and their corresponding distributions P{N; n/N < x), 
in semi q-log representation (right column). The cases 7 = and 7 = 1 do not yield g-Gaussians with g > 1 because the 
discretization never achieves the desired continuous limit (indeed, An = 5 and An/N '--^ 5 respectively). The case Q = 1 yields 
a Gaussian with a specific discretization, which only in the N ^ 00 coincides with that of the independent-coin model. 
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FIG. 4: Rate function rq{x) corresponding to typical values of ((5,7). The contirmous curves correspond to Iq{x) (Eq. \12\ 
with q Q). 
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